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Goal: Improve presence with artificial characters 
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@ Believability 
ə Definition 
ə Evaluation 
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Believability: A Complex Notion from Arts. .. 


Believable Characters 


Characters that achieve the “illusion of life” [Thomas 81]. 
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Believability Definition 


Believable Characters in Video Games 


Characters giving the illusion that they are controlled by a living entity 


Pro/Con: 
X Reminds users that they are in a video game 


V Agents are not tagged as being artificial 
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Parameters: 
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ə Measures 
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Parameters: 

ə Judges 
ə Level of experience [Bossard 09] 
ə Cultural origin [Mac Namee 04] 
ə Actors or spectators 

ə Experience 
ə Which video game 
ə Humans and/or agents for reference [Mac Namee 04] 
ə Judges know who is human and who is not 

ə Measures 


ə Questionnaire and/or body's response monitoring 
ə Questions/Answers 
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@ Agents’ Models 
@ In Industry 
@ In Research 
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Commonly-Used Models in Industry 
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Die State 
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Commonly-Used Models in Industry 


ə Finite state machines (FSM) 


ə Behavior trees 


ə Planners [Orkin 06, Fikes 71] 
State: (phone#, recipe, hungry?) 
Goal: ( - , - , NO ) 


P. à ves (B. -- NO) 
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Models for Believability 


Main work: 
ə Embodied conversational agents [Cassell 01] 
ə The Oz project [Bates 92, Reilly 96, Loyall 97] 
ə Non-Player Characters [Mac Namee 04] 
ə Animated pedagogical agents [Lester 97] 
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Main work: 
ə Embodied conversational agents [Cassell 01] 
ə The Oz project [Bates 92, Reilly 96, Loyall 97] 
ə Non-Player Characters [Mac Namee 04] 
ə Animated pedagogical agents [Lester 97] 


Pro/Con: 
V Could be used in adventure/role-playing video games 
X Aim at the other definition of believability 
X Not suited for games with a lot of action 
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Models for Believability in Action Games 


Work for agents in first person shooters: 
ə Probabilistic model, whole behavior [Le Hy 04] 
ə Classifier Systems, whole behavior [Robert 05] 
@ Probabilistic model, move behavior [Gorman 06] 
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Neural network, aiming/shooting/weapon [Gorman 07] 
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Models for Believability in Action Games 


Work for agents in first person shooters: 
ə Probabilistic model, whole behavior [Le Hy 04] 
ə Classifier Systems, whole behavior [Robert 05] 
@ Probabilistic model, move behavior [Gorman 06] 
@ 


Neural network, aiming/shooting/weapon [Gorman 07] 


Problems: 
ə Very hard to compare believability 


ə Models for whole behavior are rare 
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@ Imitation Learning 
ə Definition and Advantages 
ə Application to Machine Learning 
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Definition and Advantages 


Imitation Learning 


Increased tendency to execute a previously demonstrated behavior. 


Advantages: 
ə May improve believability [Schaal 99] 
ə Make character design possible for non-programmers 


ə Mostly used in robotics, application to video games possible 
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Imitation is Complex 


“Fitness function”: 


ə Believability 


Over-learning and Over-generalization : 
ə An agent is not a film 
ə But it should copy the behavior 


Additional constraints: 
ə Fast and online learning can enhance believability 
ə Can handle a lot a examples (MMO) 
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ə Neural gas [Thurau 04] 
e Learns the topography and paths 
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Work Using Imitation Learning 


Algorithms to learn by imitation: 
ə Neural gas [Thurau 04] 
e Learns the topography and paths 
ə Levenberg-Marquardt algorithm [Gorman 07] 


e Short-term anticipation 
ə Good believability 


ə Baum-Welch algorithm [Le Hy 04] 
ə Online learning 
ə [Rao 04] used by [Gorman 06] 


ə Based on Metzoff’s work 
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Conclusion 


Summary 


Believable Characters in Video Games 


Characters giving the illusion that they are controlled by a living entity 


Believable agents’ models for video games: 
ə Are still too young for industry 


e Begins to give good results 
Imitation learning for those models: 


@ Increase believability 


ə Simplify the parametrization 
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Conclusion 


Outlook 


Next steps: 
@ Define a believability evaluation for first person shooters 
@ Find/Develop models that can generate believable behaviour 
@ Use imitation learning to learn the parameters 


@ Comparate the models 
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